Skip to content

From NVIDIA Megatron-LM for visibility - #18

Open
RaymondLi0 wants to merge 8569 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

RaymondLi0 wants to merge 8569 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0

Copy link
Copy Markdown
Collaborator

No description provided.

@RaymondLi0
RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0
RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
balasaajay and others added 27 commits October 20, 2026 08:01
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
Signed-off-by: Cory Ye <cye@nvidia.com>
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
Signed-off-by: Dmytro Pykhtar <dpykhtar@nvidia.com>
Signed-off-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Signed-off-by: janEbert <janpabloe@nvidia.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Co-authored-by: Jan Ebert <janpabloe@nvidia.com>
Signed-off-by: Asha Anoosheh <aanoosheh@nvidia.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
)

Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
Signed-off-by: Anil Thomas <anthomas@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: wdykas <wdykas@nvidia.com>
Signed-off-by: Zhiyu Li <zhiyul@nvidia.com>
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: Alok Tripathy <atripathy@nvidia.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
…ent from latest TE API (#8184)

Signed-off-by: zhongboz <zhongboz@nvidia.com>
Signed-off-by: ykarnati <ykarnati@nvidia.com>
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
Signed-off-by: Dmytro Pykhtar <dpykhtar@nvidia.com>
Signed-off-by: Maanu Grover <maanug@nvidia.com>
Co-authored-by: Maanu Grover <maanug@nvidia.com>
Signed-off-by: Zhiyu Li <zhiyul@oci-aga-slurm-1-dm-02.cm.cluster>
Co-authored-by: Zhiyu Li <zhiyul@oci-aga-slurm-1-dm-02.cm.cluster>
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
…t-case buffers (#8385)

Signed-off-by: wdykas <wdykas@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: ykarnati <ykarnati@nvidia.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
Signed-off-by: Mikail Khona (NVIDIA) <mkhona@nvidia.com>
Signed-off-by: Kwangjun Ahn <kwangjuna@nvidia.com>
Co-authored-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
rapatel and others added 30 commits November 7, 2026 23:36
Squash merge source PR #8787 at f14a30f.

Validated with #8787, #8548, and #8261 in batch #9100.
CI: https://github.com/NVIDIA/Megatron-LM/actions/runs/42410747137
Tested synthetic merge: 2c17800
The Nemo_CICD_Test aggregate passed, including required unit and functional tests.
Downstream MBridge is independent of that aggregate; no additional result is claimed.
Upstream drift since validation: PR #9061; 36 reviewed files, with 2 shared files containing independent hunks; patches commute
The specified GPU run tested its recorded base; later upstream changes received static integration verification only.

Signed-off-by: Ritesh Patel <ripatel@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Ritesh Patel <ripatel@nvidia.com>
Squash merge source PR #8548 at bb8250c.

Validated with #8787, #8548, and #8261 in batch #9100.
CI: https://github.com/NVIDIA/Megatron-LM/actions/runs/42410747137
Tested synthetic merge: 2c17800
The Nemo_CICD_Test aggregate passed, including required unit and functional tests.
Downstream MBridge is independent of that aggregate; no additional result is claimed.
Upstream drift since validation: PR #9061; 36 reviewed files, with 2 shared files containing independent hunks; patches commute
The specified GPU run tested its recorded base; later upstream changes received static integration verification only.

Co-authored-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: Tong Liu <tongliu@nvidia.com>
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Tong Liu <tongliu@nvidia.com>
Squash merge source PR #8261 at 4d4469f.

Validated with #8787, #8548, and #8261 in batch #9100.
CI: https://github.com/NVIDIA/Megatron-LM/actions/runs/42410747137
Tested synthetic merge: 2c17800
The Nemo_CICD_Test aggregate passed, including required unit and functional tests.
Downstream MBridge is independent of that aggregate; no additional result is claimed.
Upstream drift since validation: PR #9061; 36 reviewed files, with 2 shared files containing independent hunks; patches commute
The specified GPU run tested its recorded base; later upstream changes received static integration verification only.

Signed-off-by: wdykas <wdykas@nvidia.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: William Dykas <wdykas@nvidia.com>
Co-authored-by: William Dykas <wdykas@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: wdykas <wdykas@nvidia.com>
This reverts commit ae47f9b.

Back out #8261
pending full approval and actual merge-queue admission.

Signed-off-by: oliver könig <okoenig@nvidia.com>
This reverts commit bc82433.

Back out #8548
pending full approval and actual merge-queue admission.

Signed-off-by: oliver könig <okoenig@nvidia.com>
This reverts commit 4e9de28.

Back out #8787
pending full approval and actual merge-queue admission.

Signed-off-by: oliver könig <okoenig@nvidia.com>
This reverts commit d3660cb.

Back out #8520
pending full approval and actual merge-queue admission.

Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
…core/ops with deprecated aliases (#8656)

Signed-off-by: guihong-nv <guihongl@nvidia.com>
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Ajay Balasa <abalasa@nvidia.com>
…oss ranks (#8997)

Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
Co-authored-by: Roger Waleffe <rwaleffe@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
Signed-off-by: Xiaoda Zhang <xiaodaz@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: janEbert <janpabloe@nvidia.com>
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
Signed-off-by: Chen Cui <chcui@nvidia.com>
Signed-off-by: wdykas <wdykas@nvidia.com>
Signed-off-by: William Dykas <wdykas@nvidia.com>
Co-authored-by: wdykas <wdykas@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Land the reviewed source PR after joint validation in #9272.

Source-head: f8ed592
Batch-tested-merge: 9b51edb

CICD Megatron-LM run 42812745154: Nemo_CICD_Test passed, including the selected unit and functional tests. MBridge downstream validation did not run past its test approval gate; the parent waiter timed out.

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Skand Hurkat <shurkat@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Land the reviewed source PR after joint validation in #9272.

Source-head: 05a8f4f
Batch-tested-merge: 9b51edb

CICD Megatron-LM run 42812745154: Nemo_CICD_Test passed, including the selected unit and functional tests. MBridge downstream validation did not run past its test approval gate; the parent waiter timed out.

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Laura Dang <laurad@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: adistomar <adityatomar2604@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: guihong-nv <guihongl@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
)

Signed-off-by: Laura Dang <laurad@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.